PASSIVE TRANSMISSION LINE EQUALIZATION USING CIRCUIT-BOARD 
THRU-HOLES 



FIELD OF THE INVENTION 

This invention relates generally to backplanes, and more specifically to backplane 
wiring systems for highly interconnected, high-speed modular digital commimications 
systems such as routers and switches. 

BACKGROUND OF THE INVENTION 

A backplane generally comprises a printed circuit board having a number of card 
connection slots or bays. Each slot or bay comprises, e.g., one or more modular signal 
connectors or card edge connectors, mounted on the backplane. A removable circuit board or 
"card" can be plugged into the connector(s) of each slot. Each removable circuit board 
contains drivers and receivers necessary to communicate signals across the backplane with 
corresponding drivers and receivers on other removable circuit boards. 

One or more layers of conductive traces are formed on and/or in the backplane. The 
traces connect to individual si^al connection points at the various slots to form data lines 
and control lines. 

Router backplanes present a challenging area of circuit board design (for convenience, 
routers and switches will be referred to herein collectively as "routers", as the technical 
distinctions between the two are unimportant to the invention as described herein). By their 
very nature, configurable modular routers require a high degree of interconnectivity between 
their removable router cards. With any appreciable number of cards, it becomes infeasible to 
build large parallel point-to-point connection buses between each pairing of the cards. This 
limitation hinders fiirther growth in large router throughput, as the next generation of large 
routers may well see throughput requirements measured in terabits-per-second. As such 
throughput requirements may require several tens (or even himdreds) of logical ports to 
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FIELD OF THE INVENTION 

This invention relates generally to backplanes, and more specifically to backplane 
wiring systems for highly interconnected, high-speed modular digital commimications 
systems such as routers and switches. 

BACKGROUND OF THE INVENTION 

A backplane generally comprises a printed circuit board having a number of card 
connection slots or bays. Each slot or bay comprises, e.g., one or more modular signal 
connectors or card edge connectors, mounted on the baclqjlane. A removable circuit board or 
"card" can be plugged into the connector(s) of each slot. Each removable circuit board 
contains drivers and receivers necessary to commvmicate signals across tiie backplane with 
corresponding drivers and receivers on other removable circuit boards. 

One or more layers of conductive ti-aces are formed on and/or in the backplane. The 
traces connect to individual signal connection points at the various slots to form data lines 
and control lines. 

Router backplanes present a challenging area of circuit board design (for convenience, 
routers and switches will be referred to herein collectively as "routers", as tiie technical 
distinctions between the two are unimportant to the invention as described herein). By their 
very nature, configurable modular routers require a high degree of interconnectivity between 
their removable router cards. With any appreciable number of cards, it becomes infeasible to 
build large parallel point-to-point connection buses between each pairing of the cards. This 
limitation hinders further growth in large router throughput, as the next generation of large 
routers may well see throughput requirements measured in terabits-per-second. As such 
throughput requirements may require several tens (or even hundreds) of logical ports to 
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exchange data simultaneously at twenty to one-hundred Gigabit-per-second (Gbps) speeds, it 
can be appreciated that the connectivity and throughput requirements placed on large router 
backplanes are extreme. 

Many router manufacturers, beheving that the limits of electrical circuit boards have 
5 been reached in the area of large router backplanes, are now designing optical backplanes for 
their next-generation products. Optical backplanes avoid some of the most problematic 
a,.; characteristics of electrical backplanes, such as trace density, signal attenuation, signal 
ri reflection, radiated noise, crosstalk, and manufacturing limitations — characteristics that 

Kl become increasingly significant as single-trace signaling speeds push into the multi-Gbps 

W: 

16 range. Optical backplanes, however, come with their own set of problems, chief among these 

pi 

bemg cost and complexity. 

SUMMARY OF THE INVENTION 

- ; This disclosure describes an electrical router backplane that overcomes many of the 

electrical and mechanical limitations of large prior art electrical backplanes, and methods for 

15 its design and fabrication. Generally, this backplane comprises multiple high-speed signalmg 
layers of differential signaling pairs, separated by ground layers. Preferably, power 
distribution layers and/or low-speed signaling layers are embedded near the center of the 
backplane stack, between outer groups of high-speed signaling layers. Various additional 
design features can be combined within this general architecture to produce a bac]q)lane that 

20 has been tested for reHable communication at single trace pair differential-signaling speeds 
up to 10.7 Gbps, 200-ampere power distribution, and overall backplane throughput greater 
than 1.6 Terabits/second. 

hi the present disclosure, a wide range of new backplane features and manufacturing 
processes are disclosed, each of which contributes to the overall success of the backplane 

25 design. Preferably, these aspects are combined in a single backplane to provide an 
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accumulation of the benefits of each aspect. 

BRIEF DESCRIPTION OF THE DRAWING 

The invention may be best understood by reading the disclosure with reference to the 
drawing, wherein: 
5 Figure 1 contains a block diagram of a high-speed router; 

Figure 2 illustrates one possible path for traffic entering a router at one line card and 
exiting the router at another line card; 

Figure 3 shows the external layout for a router backplane circuit board according to 
one embodiment of the invention; 
40 Figure 4 shows the same layout as Figure 3, with superimposed intemal differential 

pair trace routing for the connections between one Hne card and one switching fabric card; 

Figure 5 shows several high-speed differential signal trace pairs passing through a 
card connector region of a router baclqjlane; 

Figure 6 shows a high-speed signal trace pair on one signaling plane of a router 
1 5 backplane connected to a pair of signal thru-holes, with a loop in one trace to equalize trace 
length; 

Figure 7 shows the panel mask for one power plane of a router baclq)lane; 
Figure 7 A contains a magnified section of the mask of Figure 7, showing an isolation 
cutout used for isolating mechanical equipment power fi-om router card power; 
20 Figure 7B contains a magnified section of the mask of Figure 7, showing a guard ring 

that surrounds the power plane; 

Figure 8 shows the complete material stack in cross-section for a router backplane 
according to a hybrid dielectric embodiment of the invention; 

Figure 9 shows the complete material stack in cross-section for a router baclq)lane 
25 according to a singe-dielectric-material embodiment of the invention; 
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Figure 1 0 illustrates a cross-section through one section of a router backplane high- 
speed signal layer, illustrating a trace/ground plane/dielectric layer configuration according to 
an embodiment of the invention; 

Figure 1 1 depicts an ideal eye diagram for a differential signal; 
5 Figure 12 depicts a fully open eye diagram for a differential signal; 

Figure 13 depicts a non-preferred eye diagram illustrative of what might be expected 
with a backplane without the tailored stub capacitance of Figure 15; 

Figure 14 plots an eye diagram typical of a router backplane operating at 3.125 GHz 
with signal thru-holes as shown in Figure 15; 
4D Figures 1 5a and 1 5b each illustrate a signal thru-hole and a ground hole in cross- 

section for a router backplane according to two embodiments of the invention; 

Figures 16-19 illustrate various pad and clearance configurations useful with the 
signal thru-hole of Figures 15a and 15b; 

Figure 20 shows the panel mask for a high-speed signaling layer in a router 
15 baclq)lane; 

Figure 21 illustrates a partial cross-section of a router backplane, illustrating how 
shorter differential pairs connect at shallower signal layers and longer differential pairs 
connect at deeper signal layers; 

Figures 22a and 22b show, respectively, exploded and assembled views for the first 
20 lamination cycle of a two-lamination cycle process ; 

Figure 23 contains a magnified portion of the mask of Figure 20, illustrating thieving 
used in an embodiment; 

Figure 24 shows the panel mask for a digital ground plane in a router backplane; 

Figure 25 illustrates thieving for two adjacent low-speed signaling layers; and 
25 Figure 26 illustrates a teardrop signal pad used on low-speed signaling layers. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

1 DEFINITIONS 

Several terms have been assigned particular meanings within the context of this disclosure. 
As used herein, high speed signaling refers to signaling on a differential signal pair at a data 
rate greater than about 2.5 Gbps. A high-speed signaling layer or high-speed differential 
trace plane contains high-speed differential signal trace pairs, but may also contain lower 
speed and/or single-ended traces. A core dielectric layer is one that is cured and plated prior 
to assembly of a circuit board. A b-stage dielectric layer is one that is cured during assembly 
of cores into the circuit board. Differential signaling (or balanced signaling) is a mode of 
signal transmission, using two conductors, in which each conductor carries a signal of equal 
magnitude, but opposite polarity. Single-ended signaling (or unbalanced signaling) is a 
mode of signal transmission where one conductor carries a signal with respect to a common 
groimd. The impedance of a differential trace is more differential than single-ended if the 
impedance between that trace and its differentially paired trace is less than the impedance 
between that trace and ground. 

2 BASIC ROUTER CONFIGURATION AND OPERATION 

By way of introduction, one type of router configuration that can take advantage of 
the backplanes disclosed herein will be described. Figure 1 shows a high-level block diagram 
for a router 20. Line cards 30, 40, 50, and 60 provide physical ports to the device. For 
imtance, hne cards 30 and 40 can each provide up to 24 Gigabit Ethernet ports 22 into router 
20. Line card 50 provides two 10-Gigabit Ethernet ports 52, and line card 60 provides an 
OC-192 PCS (Packet-Over-Sonet) port 62. Although four line cards are shown, many 
backplanes provide slots to accommodate many more cards, e.g., up to fourteen line cards in 
the embodiment shown in Figure 3. The user can configure device 20 to accommodate 
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different traffic capacities, traffic models, and physical port mixes by the appropriate 
selection of numbers and types of hne cards. 

Switching fabric 70 switches each routed data packet from that packet's ingress 
port/hne card to that packet's egress port/line card. Switching fabric 70 connects to each line 
5 card through two full duplex switching fabric port connections (see, e.g., port connections 44, 
46 to line card 40). Switching fabric 70 can be reconfigured rapidly on an epoch-by-epoch 
basis (an epoch is a defined time slice). For instance, at one epoch, fabric 70 may be 
t' switching packets from ingress port 44 to egress port 54 and from ingress port 46 to egress 
port 66, and at the next epoch, fabric 70 could be switching packets from ingress port 44 to 
|0 egress port 64. At any given epoch, ingress ports and egress ports are paired to utilize as 

many switching ports as possible without unduly delaying a particular set of packets. 
% In an embodiment using the backplane of Figure 3, the switching fabric functionality 

!l is distributed among nine identical switch fabric cards, eight of which are ganged to actively 

rii 

switch packet data in parallel (the ninth provides redundancy). In this configuration, a fiill- 
15 duplex switching fabric "port" actually comprises 18 differential pairs connected to a line 
card — one transmit pair from the line card to each switch fabric card, and one receive pair 
from each switch fabric card to the line card. 

Route processing module (RPM) 80 resides on an RPM card. RPM 80 has several 
duties. RPM 80 is responsible for overall system operation, i.e., recognizing and booting new 
20 line cards, identifying faulty line cards, packet route discovery, and sharing routing table 

information with the line cards. RPM 80 also provides a user interface (not shown) to allow a 
system operator to configure the system and view system parameters. For each of these 
fimctions, RPM 80 generally communicates with the hne cards over confrol bus 90. As 
compared to the switching fabric ports, the control bus can be a relatively low-speed channel. 
25 Another duty of RPM 80 is scheduling switching fabric 70. hi a preferred 
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implementation, RPM 80 reconfigures switching fabric 70 every epoch. RPM 80 uses 
scheduling bus 92 to communicate to switching fabric 70— as well as to line cards 30, 40, 50, 
60 — ^the switching fabric configuration for the upcoming epochs. RPM 80 attempts to 
schedule as many fabric ports as possible during each epoch, and to ensure that data is 
handled promptly and fairly. As compared to the switching fabric ports, the scheduling bus 
can be a relatively low-speed channel. 

RPM 80 also maintains its own switching fabric port connection 82, allowing it to 
receive and transmit packets external to the router using any of the line card physical ports. 
In the backplane design of Figure 3, provision is also made for a second RPM card connected 
to router 20 to provide failover capability. 

Figure 2 shows an exemplary data path taken by part of a packet as it traverses router 
20. Figure 2 depicts three cards that would be inserted in a typical system — an ingress line 
card 30, an egress line card 50, and a switch fabric card 70a. Note that a fully fimctional 
system would also contain at least seven additional switch fabric cards and at least one 
functioning RPM card, but these have been omitted from Figure 2 for clarity. 

Cards 30, 50, and 70a are shown connected to a backplane 100 using board 
connectors and sockets, of which the numbered connectors 35, 55, 75 and numbered sockets 
37, 57, 77 are typical. The board connectors are press-fit onto their respective cards, and the 
matching sockets are press-fit onto the baclqplane. A card then can be connected to the 
backplane by mating the connectors with the sockets at a desired card slot. Other connectors 
(such as connector 39) located at each slot perform fimctions such as supplying power to a 
card. 

The number of integrated circuits and division of circuitry fimctions on a card can be 
varied in many ways, as this is not critical to the present invention, hi Figure 2, line card 
circuitry is illustrated in one possible configuration: an ingress circuit (31 and 51) for 
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processing packets received at the line card, an egress circuit (32 and 52) for processing 
packets to be transmitted by the line card, and a serdes (serializer/deseriaUzers 33 and 53) for 
passing packets between the ingress/egress circuits and the switch fabric cards. Switch fabric 
card circuitry is illustrated in one possible configuration also: a switch 71 in communication 
5 with a serdes 73 to pass packet data between switch 7 1 and the line cards. 

One possible data path through router 20 is shown in Figure 2. An incoming packet 
Packetin is received at a port on line card 30. Ingress circuit 31 processes the packet, 
£:i determines that the appropriate router egress port is on line card 50, and queues the packet m 
a queue corresponding to line card 50. At an appropriate epoch, one data path of switch 71 is 

Si 

Ip configured (along with the corresponding switches on the other switch fabric cards, not 

J,, shown) to switch data from line card 30 to line card 50. During that epoch, serdes 33 

m 

'f\ receives the exemplary packet's data fi-om the queue, serializes it, and transmits a portion of 

if 

p| that data to each switch fabric card. Serdes 33 transmits the portion of that data bound for 

lii 

switching fabric card 70a over a physical path comprising connector 35, socket 37, 
1 5 differential pair 34a in backplane 100, socket 77, and connector 75 . Serdes 73 receives that 
data, de-serializes it, and passes it to switch 71. Switch 71 switches the data to an appropriate 
channel for line card 50, and then passes the data back to serdes 73. Serdes 73 reseriahzes 
and transmits the data over a physical path comprising connector 75, socket 77, differential 
pair 56a in backplane 100, socket 55, and connector 57. Serdes 53 combines the serial data 
20 received fi-om the switch fabric cards and passes the de-serialized data to egress circuit 52. 
Egress chcuit 52 performs additional packet processmg, and queues the packet for 
transmission out the appropriate egress port as PacketOut. 
3 BACKPLANE LATERAL LAYOUT 

The description of the backplane design is divided into two sections. This first 
25 section describes aspects of the embodiments of the invention as they relate to the lateral 
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layout of the backplane. A second section will describe aspects of the embodiments of the 
invention as they relate to the backplane cross-section design. 

3.1 General Arrangement 

Figure 3 shows a detailed backplane-plating layout for a router 20 and backplane 100 
5 as described in Figures 1 and 2. A top panel region of backplane 100 has connector regions 
("slots") for sixteen cards. The outboard seven slots on each end are each configured to 
accept a Une card (slots LCO to LC6 and LC7 to LCI 3). The middlemost two slots are each 

" configured to accept a route-processing module (slots RPMO and RPMl). Each slot has three 

r 

' upper connector regions (e.g., regions JL4U0, JL4U1, and JL4U2 for slot LC4) used to 
10 distribute power and ground signals to a card. Below these, each line card slot has three 
r high-speed connector regions (e.g., regions JLC4A, JLC4B, and JLC4C for slot LC4). The 
RPM slots serve more card connections than the Une card slots, and therefore use a larger 
high-speed connector region. In one embodiment, the high-speed connector regions are laid 
out to accept HS3 press-fit sockets, available firom Tyco Electronics Corporation (formerly 
15 AMP Incorporated). 

A bottom panel region of backplane 100 contains connector regions or slots for nine 
cards. Each of these slots in configured to accept a switch fabric card (slots SFO to SF8). 
Each slot has two lower comiector regions (e.g., regions JSF8U0 and JSF8U1 for slot LC8) 
used to distribute power and ground signals to a switch fabric card. Above these, each switch 
2Q fabric card slot has three high-speed connector regions (e.g., regions JSF8A, JSF8B, and 
JSF8C for slot SF8). 

The bottom panel region also contains connector regions for connecting power and 
ground to the backplane. Two 48-voh power distribution layers are embedded in backplane 
100, an "A" power distribution layer and a "B" power distribution layer. At the lower left of 
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backplane 100, two large multi-thru-hole regions 48V A and 48 VA RTN allow for connection 
of "A" power supply and return leads to one power supply, and a third large region CGND 
allows for connection of a common ground. Similar connections for a "B" power distribution 
layer to a second power supply exist at the lower right of backplane 100. 

5 3.2 Signal Distribution 

One advantage of the layout of Figure 3 is that it allows for efficient routing of the 
''I high-speed signaling connections between the various cards. The RPM card slots are 

centrally located, as they require the highest number of connections. The switch fabric cards 
are also centrally located, but below the hne cards and RPM cards, providing routing room 
1 0 for the connections between the switching fabric card rank and the line/RPM card rank. 

As will be described below, the preferred backplane embodiments utiUze specific 
combinations of high-speed signaling layers, low-speed signaling layers, and power 
distribution layers to provide the connections necessary for router functionality. The high- 
speed connector regions of backplane 100 interconnect using the high-speed signaling layers. 
1 5 Although connections that operate at relatively low speeds — such as the router's control bus, 
scheduling bus, and clock distribution traces — can also utilize the high-speed layers, separate 
low speed layers are preferably provided for them. The power distribution layers are used to 
distribute power from the router's power supplies to the router's cards. 

3.2.1 Differential Pair Configuration 

20 High-speed signaling across the baclqjlane preferably utilizes differential trace pairs. 

One aspect of the present invention therefore involves the routing layout of differential trace 
pairs within the high-speed signaling layers. Achieving a workable routing layout using pre- 
existing techniques would be, at best, difficult, due to several other attributes of the preferred 
embodiments. For instance, the preferred pitches for differential pairs are eight mil traces on 
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sixteen-mil spacing and seven mil traces on seventeen mil spacing — much wider than a 
conventional differential pair (e.g., eight mil spacing for eight mil traces) might use. This 
preferred pitch decreases achievable differential pair routing density on a given signaling 
layer. Also, in order to limit maximum trace length and pack a large number of cards into a 
5 standard rack-mounted chassis space, routing space between cards (and their respective 
connector regions) has been Kmited — ^when combined with the preferred differential pair 
pitch, the resulting configuration allows only about five differential pairs to be routed side- 
J=f by-side between any two adjacent cards on a given signaling layer. Further, to ensure 
fi! manufacturability, the number of high-speed signaUng layers is also limited, e.g., to ten in 

cil 

Hf) this embodiment. 

f l 3.2.2 Typical Routing Paths 

Within the constraints identified above, Figure 4 illustrates high-speed differential 
pair routing for one exemplary line card slot to switch fabric card slot. Each line card slot 

Hi 

(and RPM slot) connects in similar fashion to each switch fabric card slot for purposes of 
1 5 high-speed signaling. As shown in Figure 4, line card slot LC3 connects to switch fabric card 
slot SF7 via four differential pairs 102, 104, 106, 108. Two of these differential pairs are 
used for high-speed signaling from LC3 to SF7; the remaining two are used for high-speed 
signahng in the opposite direction. 

In some embodiments, some (or all) differential pairs connecting switch fabric card 
20 slot SF7 to the other line card (and RPM) slots reside on a common high-speed signaling 
layer with differential pairs 102, 104, 106, 108. The non-illustrated pairs route in similar 
fashion to the illustrated pairs, with line card slots nearer the center of the backplane 
connecting to SF7 nearer its top, and line card slots nearer the ends of the backplane 
connecting to SF7 nearer its bottom. Left-side line card slots generally coimect to thru-holes 
25 on the left of slot SF7, and right-side line card slots connect to thru-holes on the right of slot 
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SF7. Generally, similar routing exists on the other high-speed signaling layers as well (each 
layer generally serving one switch fabric card slot), with one exception that will be described 
shortly. 

3.2.3 Paths Through Connector Regions 

Because in this type of embodiment a large number of differential pairs (more than 60 
in some cases) route to one switch fabric card slot on each high-speed signaling layer, at least 
some pairs must pass through the connector regions for other switch fabric card slots if a tight 
card spacing and short switch fabric card height are to be maintained. In Figure 4, pairs 102 
and 104 pass through two connector regions each (SF5 and SF6), pair 106 passes through 
three connector regions (SF4, SF5, and SF6), and pair 108 passes through five connector 
regions (SF3, SF4, SF5, and SF6). In a worst case, a differential pair may have to pass 
through eight switch fabric connector regions. 

The connector regions are densely populated with alternating rows of signal and 
ground pins, again, in order to minimize space requirements. One aspect of the invention 
involves a particular way of routing differential pairs through the connector regions that 
largely avoids crosstalk and signal attenuation. Exemplary differential pan: routings of this 
type are illustrated m the scale drawing of Figure 5. 

Figure 5 illustrates in top view a segment 110 of a high-speed signaling layer, 
showing typical scale spacing for the thru-holes in a connector region. This segment contauis 
rows of six signaling pin thru-holes (e.g., holes 1 12a-f in one row) alternating with rows of 
three ground pin thru-holes (e.g., holes 1 14a-c in one row). The configuration is typical of a 
thru-hole pattern used with an AMP HS3 connector. 

Each thru-hole is plated, with each signaling thru-hole used in the backplane 
potentially carrying a high-speed signal. Thus the potential for signal interference exists each 
place that a differential pan: is routed past a signaling thru-hole. The preferred embodiments 
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minimize this potential interference by routing differential pairs through connector regions in 
an alignment that intersects a row of ground pin thru-holes (see, e.g., differential pair 1 16a, 
11 6b). This places the differential pairs as far as possible from the neighboring signaling pin 
thru-holes, and at the same time largely maintains the desirable impedance characteristics of 
5 each trace pair as it traverses the connector region. 

The traces of the differential pairs already route with approximately a six- to eight-mil 
U spacing, measured vertically in the material stack, from adljacent ground planes. 

C:l Consequently, very little net trace-to-groimd impedance effect results from passing such a 

IP 

trace horizontally past a groimd pin thru-hole (connected to those same ground planes) by 
|f) roughly a ten-mil spacing. Further, the use of traces that are only slightly more differential 

PI than single-ended allows pairs of traces to split and couple with a thru-hole without greatly 

fll 

fl affecting transmission. 

m 

Q The preferred embodiments use a routing layout that splits a differential pair as it 

approaches a ground-pin thru-hole, allowing one trace to pass on one side of the hole and the 

1 5 other trace to pass on the other side of the hole. Once past the thru-hole, the two traces rejoin 
in the differential configuration on the opposite side of the hole. This approach 
advantageously allows the differential pair to retain a differential configuration along much 
of its path through a via connection region, while avoiding interference to a large degree with 
signals present in signaling thru-holes in that via connection region. 

20 In the preferred configuration (illustrated by differential pair 116a, 11 6b), the 

centerUne of the differential pair is aligned with the centerline of the row of ground pin thru- 
holes (1 14a-c). As traces 1 16a and 1 16b approach ground pin thru-hole 1 14a from the left, 
the traces turn and separate at approximately a 90-degree angle (the traces routed respectively 
at plus and minus 45 degrees from their original direction of travel) until separated by more 

25 than the clearance required for the thru-hole. The traces then turn back and pass the thru-hole 
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parallel to each other, and rejoin again at approximately a 90-degree angle until reaching the 
original differential configuration. Traces 1 1 6a and 11 6b route in substantially the same 
manner around ground pin thru-holes 1 14b and 1 14c before exiting the card connector region. 
Although the routing illustrated for traces 11 6a, 11 6b is preferred, other routings are 
5 possible. For instance, differential pair 124a, 124b approach ground pin thru-hole row 126a-c 
shghtly off axis from the left, allowing trace 124a to pass just above thru-hole 126a without 
turning. Trace 124b turns downward to pass just below thru-hole 126a, and then straightens 
out. After trace 124a passes thru-hole 126a, it also turns downward to rejoin trace 124b in a 
differential configuration. On approaching ground pin thru-hole 126b, this pattern is reversed 
ftO as the differential pair jogs back upwards, and so on. An advantage of this routing is that it 
■ requires only half the trace turns required by the routing of traces 1 1 6a, 1 1 6b. Disadvantages 
are that the traces are placed somewhat nearer some adjacent rows of signahng thru-holes, 
and the traces depart from their differential configuration for longer segments. 

Figure 5 illustrates other useftil differential pair constructs. For instance, differential 
15 pair 118a, 11 8b is routed through region 110 to two signal pin thru-holes 120a, 120b. This 
differential pair remains aUgned with a row of ground pin thru-holes (122a-c) until reaching 
the proximity of signal pin thru-holes 120a, 120b. The differential pair then angles towards 
signal pin thru-holes 120a, 120b such that the differential configuration is maintained as long 
as possible. 

20 3.2.4 Differential Pair Path Matching 

Note that as described and shown in Figure 5, differential trace 1 1 8a is slightly longer 
than differential trace 11 8b. hi some situations, it may be possible to reverse this 
configuration on the other end of the frace pair, such that trace length is equaUzed. Removing 
path mismatch present at one end of a differential pair by an offsetting mismatch at the other 
25 end of the pair is not, however, always possible or preferable. Accordingly, Figure 6 
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illustrates a trace termination configuration for use in such situations. A looped jog 130 is 
placed near the source end of trace 1 1 8b, thus approximately equalizing the length of 
nominally shorter trace 1 1 8b with the length of nominally longer trace 1 18a. 

Note that as shown in Figure 6, looped jog 130 more than compensates for the extra 
length in trace 1 18a. This extra lengtii in trace 11 8b also compensates for a path length 
difference in the AMP HS3 connector for the pins that connect to traces 1 18a and 1 18b. 
Simply crossing the traces could compensate for the connector path length difference, such 
that at the exit end of the traces trace 1 18b connected to the connector pin with the longer 
path length. In the disclosed embodiments, this is non-preferred. Otherwise, the rising signal 
edge on one trace and the corresponding faUing signal edge on the other trace will be 
misaligned over the entire backplane path, causing signal distortion and diminishing the 
common-mode noise rejection capability of the differential pair. Note that it is extremely 
difficult to completely eliminate misalignment between the rising and falling signal edges on 
a differential pair, but the described jog technique greatly diminishes the problem. 

3.3 Power Distribution 

The preferred embodiments utilize a novel power distribution scheme employing four 
relatively Hiick conductive planes near the center of the backplane for power distribution to 
the line and switch fabric cards. These planes provide a relatively noise-free and economic 
power distribution scheme for a router, as compared to more conventional power distribution 
approaches such as bus bars or separate power distribution circuit boards. The present 
embodiments are beUeved to be the first backplanes capable of distributing 100 amperes or 
more of current to attached components (in the preferred embodiment, two distinct power 
distribution planes are each capable of distributing 200 amperes of power). 
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3.3.1 Power Blocks/Location 

Figure 3 shows the power entry/exit points for a preferred backplane embodiment. 
The large plated regions 48V A, 48VA RTN, 48VB, and 48VB RTN provide connection 
points for redundant A and B power supplies. From these comer locations, power is fanned 
5 out to thru-holes for the switch fabric power connectors (e.g., JSF8U0 and JSF8U1) arranged 
along the bottom of the backplane and thru-holes for the line and RPM card power 
connectors (e.g., JL4U0, JL4U1 , and JL4U2) arranged along the top of the backplane. This 
- arrangement is preferred, in part, because it leaves more trace routing room near the center of 
% \ the backplane for creating shorter high-speed traces. 

m 3.3.2 Via-Free Paths 

\ i Figure 7 illustrates a panel mask for the 48VA power distribution plane, with dark 

IV- 

areas representing areas where copper will be etched away during patterning. In Figure 7 the 
= panel mask has been turned ninety degrees clockwise with respect to Figure 3. It can be 

appreciated from Figure 7 that power distribution is enhanced by the existence of a large 
1 5 central substantially via-free path (populated in this embodiment by a relatively few holes for 

board alignment pins). This region, Ijdng between the leftmost line card/RPM high-speed 

connectors and the rightmost switch fabric high-speed connectors in Figure 7, provides a 

wide path capable of distributing several hundred amperes of current. 

The areas between the high-speed connectors for adjacent cards are also substantially 
20 via-free. This allows power distributed through the central via-free path to channel freely 

between adjacent rows of high-speed connectors in order to reach power blocks near the top 

and bottom of the backplane. 

One aspect of the via-free path concept is an adherence to a routing design that avoids 

layer-swapping vias. In other words, every signal injected at a thru-hole to a given signal 
25 plane of the board is extracted from a second thru-hole to that same signal plane, with no 
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intermediate via(s), connected to two signal planes, that swaps the signal to a different plane. 
A layer-swapping approach is often taken in the prior art to solve routing problems, but is 
specifically avoided in the preferred embodiments of the present invention. This not only 
improves power distribution, but also avoids the creation of extraneous reflections due to 
5 intermediate vias in high-speed signal paths. 

3.4 Noise Suppression 

;=1 As mentioned previously, one advantage of the embedded power distribution layers of 

If! the preferred embodiments is enhanced noise suppression as compared to conventional 

m 

metiiods of power distribution. Some aspects of this noise suppression relate to the layer 
1 0 ordering of the backplane, and will be discussed in Section 4. Other aspects relate to the 
|l horizontal plan of the power distribution planes, in particular the use of isolation cutouts and 

the use of a copper guard ring. 

r| 

3.4.1 Isolation Cutonts for Fan Power Distribution 

In the preferred embodiment, the backplane distributes power not only to the switch 
15 fabric, RPM, and line cards, but also to power connectors for a complement of fan trays that 
provide convection air-coohng for the router. Consequently, the possibility exists for the fan 
motors to induce motor-generated noise in the backplane power layers — ^noise that could 
propagate to the power circuitry for the sensitive electronics on the router's cards. To 
decrease the degree to which such noise could reach the router's cards, "isolation cutouts" are 
20 designed into the power distribution layers. 

Figure 7 A shows a section of the mask of Figure 7. Thru-hole groups 131, 132 serve 
fan tray power coimectors in a completed router. Thru-hole groups 131, 132 enjoy a fairly 
short and unimpeded backplane path to the backplane power attachment points for 48VB 
supply and return (see Figure 3). This path does not pass near the power connectors for any 
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router card. But the power distributed to, in this instance, at least Une card LCI 3 (see Figure 
3) would tend to flow in large part past thru-hole groups 131, 132 were it not for the presence 
of cutout 133. Cutout 133 in effect raises the resistance of a current path between the 
baclqjlane power attachment points and the LCI 3 power connectors that would include thru- 
5 hole groups 131, 132, severely decreasing the share of current carried by such a path. 

3.4.2 Copper Guard Ring on Power Distribution Layers 

Figure 7 shows a mask for the entire "panel" for a backplane, including alignment 
markings, test structures (including "coupons"), and flow dam structures. After panel 
fabrication, the baclsplane board is cut from the panel. Several issues regarding this cutting 
^0 process — and the resulting board configuration and performance — are addressed by a 

particular design employed on each power plane near the board edge, as described in this 
section. 

The 48-volt power distribution planes are preferably patterned in a manner that leaves 
as much copper as possible near the board edge in the panel, in order to decrease the 

1 5 possibility of board edge delamination at these particularly thick layers. But the 48-volt 
power distribution planes practically cannot extend too close to the edges of the backplane 
board for at least several reasons: tools commonly used for separating the backplane from the 
panel wear quickly when cutting through copper, and have finite tolerances; the edge of the 
backplane will be grounded in the final product; quite a bit of digital noise projects from the 

20 edges of the high-speed layers, which may be coupled to the distributed power if the power 
planes extend to the edges of their respective layers; and product test laboratories such as 
Underwriters Laboratories specify a large minimum clearance from the edge of a board to 
any power trace (e.g., 62 mils minimum for one embodiment). 

These seemingly conflicting design concerns are solved in the preferred embodiments 

25 using a copper guard ring 134 on power distribution layers. As shown in Figure 7 and in the 
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magnified section of Figure 7B, a copper guard ring 134 is patterned around the periphery of 
the power distribution layer. Copper guard ring 134 approaches to within approximately 15 
mils of the intended edge of the board. Holes drilled through the copper guard ring at regular 
intervals and then plated (not shown in the mask) allow the guard ring to be tied to chassis 
5 ground during board plating. The power plane 136 is separated from copper guard ring 1 34 
by a moat 135. 

The copper guard ring provides several advantages. First, because the guard ring may 
exist much nearer the board edge than a power trace, board edge delamination problems at 
power distribution layers can be reduced or eliminated. Second, in the case of inadvertent 
ID delamination at some point on the board's periphery prior to edge plating, if the edge plating 
shorted, it would short harmlessly to chassis ground at the guard ring. Third, the guard ring 
provides an additional level of isolation between each power plane and noise injected at the 
board edges. 

4 BACKPLANE CROSS-SECTION 

1 5 Although many advantages exist due to improvements in the plan layout of the 

preferred backplane embodiments, perhaps even more advantages exist in the design of the 
backplane cross-section, i.e., how layers are arranged to work together in the material "stack" 
of the backplane. Two general material stacks are described below. The first, a "hybrid" 
stack, utilizes two different types of dielectric materials in the material stack. The second 

20 type of stack uses a single dielectric material in the material stack, but the material used is a 
high-speed dielectric that was previously thought to be impossible to fabricate into a board of 
this thickness. 

4.1 General Layer Arrangement - Hybrid Lamination Design 

Figure 8 illustrates the entire cross-section of the material stack in one preferred 
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baclqjlane using a hybrid material stack. The material stack of Figure 8 has 34 conductive 
layers LOl to L34 and appropriate insulating layers. For each conductive layer. Figure 8 
labels that layer with a layer thickness in mils and an identifier for the layer. Layers labeled 
"GND" are digital ground plane layers. Layers labeled "HS«" are the high-speed signaling 
5 layers, where n represents the layer number. Layers labeled "Signal xn" and "Signal yn" are 

the low-speed signaling layers. The two "A 48V" layers are the supply ("dc") and return 
H ("rtn") for one power supply, and the two "B 48V" layers are the supply and return for the 

pj other power supply. For each insulating layer, the layer is accompanied by a description of 

pi 

m whether the layer is a core or a b-stage layer, whether the layer is of low-speed ("LS") 

iri 

i© material, and the final thickness of the layer in mils. 

Several general observations regarding the material stack of Figure 8 will be made 

^ before proceeding to a more specific description. First, the low-speed signaling and power 

X distribution layers use a conventional dielectric, such as FR4 (e.g., available in the "N4000- 
6" product family line from Park/Nelco), with good reflow and adhesion characteristics that 

1 5 improve the board integrity near the thicker power distribution layers. The thinner high- 
speed layers use a dielectric with significantly lower loss at the multi-Gbps signahng rates of 
the preferred embodiments, such as a thermosetting allylated polyphenylene ether (APPE, 
e.g., the "N6000-2r' product family Une available firom Park/Nelco). The dielectric material 
transition points occur at digital grovind planes L12 and L23, which are formed on FR4 core 

20 and then bonded to N6000-21 b-stage materials. 

Also notable in this material stack is that each high-speed layer (with its differential 
signaling traces) is formed approximately equally spaced firom and between two digital 
ground planes, e.g., high-speed layer HSl is formed on layer L03, between ground planes at 
L02 and L04. Similarly, low-speed signaling layers L13 and L14 are isolated fi-om the 

25 remaining stack by two digital grounds (L12 and L15), low-speed signahng layers L21 and 
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L22 are isolated by two digital grounds (L20 and L23), and the four power distribution layers 
L15 to L19 are isolated from the remaining stack by two digital grounds (L15 and L20) at the 
center of the material stack. Further, the two power supply planes are placed between the two 
power return planes to provide yet one more layer of isolation. The result is a material stack 
that efficiently manages electromagnetic interference (EMI) to provide clean power 
distribution and good isolation for the high-speed signals. 

One additional observation is that in order to provide these capabilities, the complete 
material stack is relatively thick compared to prior art boards, i.e., approximately 280 mils 
including 34 conductive layers. This required the development of new fabrication 
techniques, as will be described in Section 5. 

4.2 General Layer Arrangement - Single-Lamination-Material Design 

A second material stack embodiment is illustrated in Figure 9. Although similar in 
many ways to the material stack shown in Figure 8, the material stack in Figure 9 differs in 
several respects. Foremost, Figure 9 uses N6000-21 dielectric material exclusively (of 
several different resin contents), resulting in a different thickness (and a different fabrication 
process) for some of the centermost layers, and producing a thicker finished board at 
approximately 335 mils. Other differences exist as well. These will be detailed during the 
description in Section 5. 

4.3 Signal Distribution 

As described generally above, high-speed signals route along the ten high-speed 
signaling layers HSl to HSIO. This section describes backplane material stack 
considerations for high-speed signaling. 

4.3.1 High-Speed Differential Pair Cross-Section 

Figure 10 illustrates in cross-section a segment of a typical high-speed layer 140. 
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This segment cuts cross-wise across a differential pair 142a, 142b and the two adjacent 
digital ground planes 144a and 144b. Two layers of 3313 N6000-21 50.6% resin content 
core material 146a, 146b space the bottom of pair 142a, 142 b approximately 7.0 to 7.5 mils 
from lower ground plane 144b. Two layers of cured (after assembly) 3313 N6000-21 50.6% 
5 resin content b-stage material 148a, 148b space the top of pair 142a, 142b approximately 6.0 
to 6.9 mils from upper ground plane 144a. The grain of the dielectric materials is aligned left- 
to-right across the backplane. 

Several trace geometries have been used in the backplane embodiments. In one 
embodiment used with the hybrid material stack, traces 142a and 142b of Figure 10 are each 
10 8 mils wide at the bottom, 7.6 mils wide at the top, and 1 .4 mils high (i.e., formed of 1-ounce 
copper). The traces are separated by a horizontal distance (measured at their bottoms) of 16 
mils. In this configuration, the single-ended (even) impedance of each conductor is 
approximately 45.7 ohms, whereas the differential (odd) impedance of each conductor is 
approximately 44.6 ohms. This differential pair configuration is thus margmally more 
1 5 differential than single-ended. 

In one embodiment used with the N6000-21-only material stack, traces 142a and 142b 
of Figure 10 are each 7 mils wide at the bottom, 6.6 mils wide at the top, and 1 .4 mils high. 
The traces are separated by a horizontal distance (measured at their bottoms) of 1 7 mils. In 
this configuration, the single-ended impedance of each conductor is approximately 48.2 
20 ohms, whereas the differential (odd) impedance of each conductor is approximately 47.3 

ohms. One attractive feature of this configuration is that for N6000-21 material, the intrinsic 
material impedance of 48 ohms is very close to, and between, the even and odd impedance 
values. 

As will be described below, the differential pair impedance characteristics have been 
25 carefully matched to the thru-hole impedance characteristics to largely preserve the eye 
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pattern for a high-speed differential signal passing through the backplane. 

4.3.2 Nonfunctional Pads and Thru-hole Configuration for Equalization 

In the preferred backplanes, the backplane utihzes a significant number of conductive 
layers in order to pass a large number of signals and supply power to circuit cards. The large 

5 number of layers resuUs in a material stack — and corresponding thru-hole length — of around 
three hundred mils. At a high-speed signaling bitrate of 3.125 Gbps and using a 01 bit 
pattern, center-to-center times between consecutive signaling "eyes" on a differential pair 
will be 320 ps. With a propagation speed of 6.29 mils per picosecond, the center-to-center 
separation between consecutive eyes traveling along a differential pair is only 2000 mils, or 

10 about three times the round-trip thru-hole length. The actual eye opening with a 01 bit 

1. pattern may be much shorter — 120 ps in some cases, corresponding to a distance of about 750 
mils along the pair. Thus when a thru-hole is considered for what it is electrically — a stub on 
a transmission Hne — it can be appreciated that for signaling at 3.125 Gbps and higher rates on 
the preferred backplanes, thru-hole reflections can present a serious problem with thru-holes 

15 of such length. 

It is recognized herein that it is possible to manipulate the single-ended impedance 
of the backplane thru-holes and differential pairs to permit higher-frequency operation of a 
baclq)lane. The effect of matching the response of the thru-holes and differential pairs can be 
appreciated by examining the simulated eye patterns shown in Figures 11 -14. 

20 Figure 1 1 illustrates an ideal eye pattem for a series of signal transitions that could 

theoretically be launched into a backplane. The "eye" of the eye pattem is the opening 
between temporally adjacent signal transitions. The differential receiver requires a minimum 
eye "opening" in order to detect a signal transition, i.e., the voltage on the positive-going 
trace must exceed the voltage on the negative-going trace by at least some threshold voltage 

25 AVth for at least some minimum amount of time ATmin before a transition can be detected. In 
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Figure 1 1, the duration of the eye opening is shown as ATi. If ATi exceeds ATmin, a receiver 
should be able to distinguish the signal transition. 

Figure 12 illustrates the type of received eye pattern that would be expected for 
relatively low-speed signaling across a differential pair. Although high-frequency attenuation 
noticeably affects the shape of the eye, the eye is still fully open, i.e., the voltage sensed on 
each trace reaches, for all practical purposes, its long-term steady-state value between signal 
transitions. The eye opening of Figure 12 is slightly time-shifted, but its duration AT2 is not 
much smaller than the duration of the ideal eye opening. 

Figure 13 illustrates the type of received eye pattern that could be expected for high- 
speed signaling across a differential pair with unmatched stubs at each end (similar in length 
to those in the described embodiments), i.e., due to reflections at the thru-holes. High-speed 
signaling stresses the eye pattern detector, as the eye cannot fully open between consecutive 
signal transitions. To compound this problem, the unmatched stubs at each end of the traces 
(which are coincidentally matched to each other) can place reflections on the differential 
pair — ^reflections that alternately constructively and destructively add to the transitioning 
signals. In some cases, a response similar to that shown in Figure 13 has been observed, 
where the eye begins to open and then begins to close due to the stub reflections, hi some 
cases, this may cause the receiver to detect two eye openings where only one should exist, or 
to detect none at all. 

Figure 14 illustrates the type of received eye pattern that could be expected for high- 
speed signahng across a differential pair with matched stubs according to an embodiment of 
the invention. By control of how reflections occur at thru-holes, a detectable eye opening 
response can be designed without the droop shown in Figure 13. 

Therefore, in the preferred approach to designing a backplane according to an 
embodiment of the invention, the transfer functions of the thru-holes and traces are 
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considered together in order to compensate for signal reflections at the thru-hole stubs. 
Considering a transmit signal Tx[t] launched into one pair of thru-holes, across a differential 
pair, and out a pair of thru-holes at the other end, the corresponding received signal Rx[t] can 
be described by the composite function 
5 RM = K[tVHi[t]*L[t]*H^[t], 

where Hi[t] is the transfer function for the thru-holes that the signal is launched in to, 
L[t] is the transfer function for the differential pair, and Ho[t] is the transfer function for the 
i" ; thru-holes that the signal is launched back out of These transfer fiinctions can take iato 

account reflection, attenuation, mode group separation, and other known effects m order to 

m 

pb predict the eye pattern for a given backplane configuration. 

The preferred embodiments utilize a novel approach to stub impedance control in 
which the impedance characteristics of each thru-hole are tailored by adjusting the smgle- 
ended coupling between that thru-hole and the digital ground and/or power distribution layers 
through which the thru-hole passes. Referring to Figure 15 a, a signaling thru-hole 170 and 

15 adjacent digital ground thru-hole 180 are shown in cross-section. In this embodiment, thru- 
holes 170 and 180 have a drilled diameter of 28 to 30 mils, with a hole plating of one mil 
minimum. The signaling thru-hole 170 passes through holes in each ground and power plane, 
and thus capacitively couples to each of these planes. This capacitive coupling is preferably 
tailored usmg non-functional pads ("deadpads") on some planes to place added capacitance at 

20 selected locations along the thru-hole. 

Although other deadpad configurations can be used in an embodiment of the 
invention, the disclosed pad configurations were selected based on several criteria. First, any 
added deadpad was given the minimum diameter that could be hit during drilling without a 
high probability of the drill bit missing the pad on one side. This allowed for the pads and 

25 their clearances to stay a reasonable size, and allowed more pads to be added. Second, the 
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pads were distributed approximately every 25% of the board, to relieve board stress and 
distribute capacitance at even intervals. Third, in the hybrid board design, each power 
distribution layer received a deadpad, since those layers were thick and near the center of the 
board (the different fabrication method and longer thru-hole barrel length of the single- 
material embodiments allowed the power layer deadpads to be taken out). Fourth, the 
clearances were increases on the power distribution layers since those pads were thicker and 
therefore had a larger area for forming a capacitor. 

With the material stack shown in Figure 15 a, a prior art signaling thru-hole without 
deadpads would have a capacitance of about 1.2 to 1.4 pF. Signaling thru-hole 170, as 
shown, has a capacitance of about 1 .6 to 2.0 pF. When matched with the differential trace 
geometry shown in Figure 10, this signaling thru-hole with added capacitance (and a small 
amount of added inductance) can substantially eliminate high-speed signaling droop such as 
shown in the eye pattern of Figure 13. 

Signaling thru-hole 170 is designed to have a specific capacitive coupling 
characteristic with the ground and power distribution planes of the backplane. On most 
ground planes, such as those of layers L02 and L04, thru-hole 170 passes through a 52-mil 
diameter clearance (see Figure 16 for a cutaway top view of layer L02 at thru-hole 170). On 
the ground planes at layers LOS, LI 5, L20, and L27, thru-hole 170 passes through a 34-mil 
diameter pad 172 (LOS) centered in a 54-mil diameter clearance (see Figure 17 for a cutaway 
top view of layer LOS at thru-hole 170, showing pad 172). On the thick power distribution 
planes at layers L16, L17, LIS, and L19, thru-hole 170 passes through a 34-mil diameter pad 
174 centered in a 70-mil diameter clearance (see Figure 18 for a cutaway top view of layer 
LI 6 at thru-hole 170, showing pad 174). Note that on the power distribution planes the 
clearances for many neighboring thru-holes merge (e.g., 170 and 1S2, 184, and 186), as the 
distance between the holes is less than twice the specified clearance. Figure 19 shows a 
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cutaway view of high-speed layer HS5 (layer Lll), illustrating the functional pad 178 
connected to trace 176 at that layer. 

Figure 1 5b is similar to Figure 15a, but shows a cross-section for a single-dielectric- 
material embodiment. Most notably, no deadpads are used on the power distribution layers, 
5 and the signal throughhole 171 passes through a 52-mil clearance on those layers. 

4.3.3 One Layer Per Switch Fabric Card 

One goal of the preferred backplane designs is to design differential signal paths with 
known and controllable impedance. To this end, the high-speed signaling differential pairs 
are each designed to run between their card connectors on a single plane, with no layer- 
10 swapping vias. In order to allow an efficient routing solution with no layer-swapping, nine of 
-I the high-speed layers are each dedicated to signaling to and from a single switch fabric card. 
For example. Figure 20 illustrates the panel mask for layer L07 (high-speed signaling layer 
HS3), which connects switch fabric card SFl (Figure 3) to each of the line cards. It can be 
appreciated that the resulting layout allows for differential pair routing that is largely direct 
1 5 and short. The tenth high-speed layer is used for short-reach signaling to several switch 
fabric cards, as will be explained next. 

4.3.4 Selection of a High-Speed Layer for Signal Routing 

Not only have the differential pairs been arranged for efficient routing, but the 
selection of which high-speed layer(s) will be used for each switch fabric card also unproves 
20 performance. Generally, the lower high-speed layers have been designed to carry the very 
longest high-speed traces, and the longest traces have been avoided on the upper high-speed 
layers. 

Referring to Figure 21, a simpUfied cross-section of a backplane 150 is illustrated. 
Cross-section 150 shows a first trace 154 and a second trace 160. First trace 154 is located 
25 on a lower high-speed layer, and connects to two thru-holes 152 and 1 56. Second trace 1 60 
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is located on an upper high-speed layer, and connects to two thru-holes 158 and 162. A 
signal launched into thru-hole 152 travels down trace 154, but also travels down the 
remainder of thru-hole 152, which forms a stub 164 that reflects the signal back in the other 
direction. Likewise, a signal launched into thru-hole 158 travels down trace 160, but also 
travels down the remainder of thru-hole 158, which forms a much longer stub 166 that 
reflects the signal back in the other direction. Similar reflections occur at the exit ends of 
traces 154 and 160. 

Longer stub 166 produces a much more problematic reflection than shorter stub 164. 
One way that this tendency is compensated for in the preferred embodiments is by routing 
shorter traces on the upper high-speed layers (where the reflections are more significant but 
the signal is not as degraded due to a long propagation path) and routing longer traces on the 
lower high-speed layers (where the reflections are less significant and thus longer path 
lengths, with more attenuation, can be tolerated). 

In conjunction with the goal of dividing traces by dedicating high-speed layers to 
switch fabric cards, the preferred embodiments use at least two techniques to select routing 
layers. First, the topmost layer — ^with the longest stubs — ^is not dedicated to a single switch 
fabric card, as this would require some longer traces to reach the outboard line cards. 
Instead, HSl serves a group of connections that are fairly short because these line cards are 
substantially vertically aligned with the corresponding switch fabric cards. Some connections 
meeting this criteria, and thus selected for HSl, are: line cards LCI 1, LC12, and LC13 to 
switch fabric card SF8; line cards LC9 and LCIO to switch fabric card SF7; and line cards 
LC7 and LC8 to switch fabric card SF6. 

A second technique for reducing trace length on the upper layers is to select line card 
connector pins in a manner that results in shorter lengths for the upper layers. For instance, 
looking at Figures 3 and 20 in conjunction, it can be appreciated that title traces connecting 
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SFl to the line cards do not use the upper set of connector blocks (JLC4A and its 
counterparts for the other cards), but use the lower pins of JLC4C and the pins of JLC4B, and 
their counterparts. This reduces the maximiim trace length on layers HS2, HS3, and HS4 by 
several inches. Starting with layer HS5, pins in JLC4A and its counterparts are used, starting 
from the bottom. Figure 4 shows typical pinouts for HS9. Thus although all high-speed 
layers contain some short traces, those with the very longest traces are those with the shortest 
via stubs. Looked at strictly from a trace length standpoint this is counterintuitive, since 
inserting the longest horizontal trace signals to and extracting them from the bottommost 
high-speed layer adds even more length — ^ahnost two-thirds of an inch in the described 
embodiments — ^to those signal paths as compared to a comparable path on the topmost layer. 

4.3.5 Low-Speed Signal Distribution 

Some backplane signaling does not operate at high switching speeds. The preferred 
embodiments designate a number of layers for use with such signals. Typically, these signals 
are single-ended signals for party buses, clock distribution, etc. In Figure 8, layers LI 3 
(Signal xl), L14 (Signal yl), L21 (Signal y2), and L22 (Signal x2) are used for low-speed 
signaling. Note that LIB and L14, as well as L21 and L22, do not have a ground plane 
interposed between them. These low-speed signaling layer pairs are, however, separated 
from adjacent high-speed layers by a digital ground plane. The low-speed signahng layer 
pairs are also separated from the power distribution layer pairs by a digital ground plane. 
This arrangement, which pushes the higher-speed signaling and return ground noise — ^with 
accompanying higher levels of EMI — ftulher fixjm the power distribution layers, serves to 
further isolate power distribution from EMI. 

4.4 Power Distribution and Noise Isolation 

Although several aspects of the matter have been discussed previously, the preferred 
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embodiments use layer stacks that allow economical distribution of power with superior noise 
isolation. The preferred arrangements of layers and choice of materials allow a significant 
amount of noise-isolated power (some embodiments are rated at 200 amperes for each power 
supply) to be distributed within a common board that also serves the high-speed and low- 
5 speed signaling needs of the router. 

4.4.1 Arrangement of Embedded Power Layers 

The particular designs of the preferred material stacks have several advantages over 
previous designs. As just discussed, the buried and ground-plane-isolated power supply 
III planes LI 6-L19 provide a relatively noise-free power distribution system for the router. 
!l*0 Were the power distributed by conventional means such as bus bars, roughly twice as much 
power conditioning and filtering would be required on each card to achieve similar noise 
characteristics. By placing the power supply planes buried between two isolating ground 
planes LI 5 and L20 and keeping power supply connections relatively isolated from signaling 
connections, the designs shown in Figures 8 and 9 avoid the need for costly power 
15 distribution components. 

Placing the power supply planes in such a thick material stack causes other 
difficulties, however. In order to keep resistance low, the power supply planes should be 
relatively thick, e.g., three- or four-ounce copper. The preferred dielectric materials for the 
high-speed layers do not fill gaps between relatively thick traces well, and therefore have 
20 been adapted herein for use in some embodiments using special processes. Furthermore, the 
preferred high-speed dielectric materials are generally ill-suited for use in such a thick 
material stack, as the stress concentrated at the locations of the thru-holes tends to cause 
splitting and cracking during thru-hole drilling. Two preferred approaches have been 
developed for dealing with these problems while allowing use of N6000 or similar dielectric 
25 material on the high-speed signaling planes. 
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4.4.2 Hybrid Lamination Design 

In the approach shown in Figure 8, the use of low-speed FR4 material on all layers 
between L12 and L23 allows the thick material stack with buried power distribution planes to 
be fabricated without creating voids. In one preferred embodiment, two 1080 N4000-6 glass 

5 sheets with a resin content of 57.5% are used on each side of each low-speed signaling layer; 
for the power distribution layers, 1080 N4000-6 sheets with a higher resin content (63.5%) 
are used to enhance gap filling. Two core sheets are used between each power distribution 
supply and return plane pair. Three b-stage sheets are used between each power distribution 
return plane and the neighboring digital ground plane. And four b-stage sheets are used 
10 between the adjacent supply planes. In this embodiment, the interface between N6000 and 
FR4 occurs at ground planes (L12 and L23), such that copper largely separates the two 
dielectric materials and good bonding is achieved. 

The via-capacitance-tailoring pads used on layers LI 5 through L20 serve a second 
purpose in that they aid the manufacturability of the board. Stress at the high-speed 

1 5 connector vias, as well as the size of the voids that must be filled during booking, are 

lessened by the use of deadpads on the power distribution planes and adjacent digital ground 
planes. 

This material stack has an added advantage for noise rejection. Note that because 
FR4 has higher losses for high frequency signals than N6000, the use of FR4 near the power 
20 distribution planes provides an additional measure of high frequency noise rejection between 
the power supply and low-speed signaling layers. 

4.4.3 Pure N6000 Lamination Design 

A second fabrication approach can produce a material stack such as shown m Figure 
9. This material stack preferably uses N6000-21 material exclusively, for high-speed, low- 
25 speed, and power distribution. The resin contents are modified near the center of the board tc 
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enhance void-filling as follows: two sheets of 3313, 50,6% resin content N6000-21 glass 
form all cores in the board except for the cores between LI 6 and LI 7, and between LI 8 and 
LI 9, where two sheets of 1080, 60.3% resin content N6000-21 glass are used. Each of the 
two patterned power cores is sandwiched between two b-stage sheets of 3313, 53.4% resin 
content and one b-stage sheet of 1080, 65% resin content N6000-21 glass per side in a first 
booking designed to fill the deep voids in the patterned four-ounce copper planes. An 
additional four sheets of 1080, 60.3% resin content b-stage material are placed between 
layers L17 and LI 8 prior to final booking, with three such layers placed between LI 5 and 
L16, and between L19 and L20. Two sheets of b-stage 1080, 60.3% resin content are also 
placed between LOl and L02, between L13 and L14, between L21 and L22, and between L33 
and L34. Like the hybrid design, b-stage material for the high-speed layers consists of two 
50.6% resin content 3313 N6000-21 glass sheets. 

An advantage of the pure N6000 design over the hybrid design is that it resolves any 
dielectric-compatibility issue that may exist with the hybrid design. 

5 FABRICATION OF A HIGH-SPEED, HIGH LAYER COUNT BACKPLANE 

Preferred methods for assembling the layers of a backplane will now be described. A 
process for single-material, multiple-lamination-cycle fabrication will be described first in its 
entirety. A process for single-lamination-cycle, hybrid-material fabrication then will be 
described where it differs firom the first process. 

5.1 Single Material/Multiple Lamination Cycle Design 

One preferred method of making a backplane embodiment uses a single high-speed 
dielectric material throughout. To improve the manufacturability of such a design, multiple 
lamination cycles are used to complete a panel. 
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5.1.1 Core Makeup 

Prior to assembly of the backplane, a first step in the fabrication of the backplane is 
the makeup of plated and patterned core sheets. For a high-speed layer, a preferred core sheet 
consists of two sheets of 50.6% resin content 3313 N6000-21, which are laminated together 
5 under laminating conditions as recommended by the manufacturer to cure them. Once 
bonded and cured, these two sheets form a core dielectric layer about 7.5 mils thick, with 
, peak roughness features on the order of 0.1 mils. Although from a mode group separation 
j;=J viewpoint this roughness would not necessarily be desirable, the desire for a smooth 
% conductor surface is preferably balanced by the need for good adhesion between N6000 and 

m 

rlD copper. 

8 The core is plated with one-oimce copper on both sides. The copper on one side is 

CI 

W patterned using an etch-compensated process to produce one of the desired layers of high- 
ly speed differential pairs; the copper on the other side is patterned using a similar process to 
' ^ produce the adjacent ground plane. In one preferred embodiment, ten differently-patterned 
1 5 copper-plated cores form the ten high-speed layers that will be assembled in the finished 

product, and another four differently-patterned cores form the four low-speed layers that will 
be assembled in the finished product. 

After patterning, the patterned cores are processed through an oxide treatment process 
that roughens the outer surfaces of the copper plating, as well as cleans them, to enhance 
20 copper-to-b-stage adhesion during the lamination cycles. Preferably, the parameters of this 
process are controlled to produce a copper surface roughness similar to that found at the 
plating-to-core-dielectric boundary. It is believed that adjusting the top-surface and bottom- 
surface trace roughness to be approximately equal prevents additional mode group separation, 
as the current traveling along the top and bottom of the traces will incur similar delays due to 
25 surface roughness. 
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The two power cores are prepared in somewhat similar fashion. Two sheets of 60.3% 
resin content 1080 N6000-21 material are laminated together under laminating conditions as 
recommended by the manufacturer to cure them. Once bonded and cured, these two sheets 
form a core dielectric layer about 6 mils thick, with peak roughness features on the order of 
0.5 mils. As the power layers do not pass high frequencies, the larger surface roughness is 
preferred in order to increase metal-to-dielectric adhesion. 

Each power core is plated with four-ounce copper on both sides. The copper on one 
side is patterned using an etch-compensated process to produce one of the desired DC supply 
planes; the copper on the other side is patterned using a similar process to produce the 
corresponding DC return plane. In the preferred embodiments, two differently-patterned 
copper-plated cores form the two sets of power planes used in the backplane. 

After patterning, the patterned power cores are processed through an oxide treatment 
process that roughens the outer surfaces of the copper plating to enhance copper-to-b-stage 
adhesion during the lamination cycles. Preferably, the parameters of this process are 
controlled to produce a copper surface roughness similar to that found at the plating-to-core- 
dielectric boundary, i.e., 0.4 to 0.5 mils for the power planes. 

5.1.2 First Lamination Cycle 

In the preferred dual-lamination-cycle embodiments, a first lamination cycle bonds 
two sheets of 3313 53.4% resin content and one sheet of 1080 65% resin content N6000-21 
material, to each side of the two power cores (layers LI 6/17 and LI 8/19, respectively). This 
separate lamination cycle, performed with high-resin-content glass, ensures that the features 
in the four-oimce patterned power planes are filled with glass and void-free. The fnst 
lamination cycle is performed under laminating conditions as recommended by the 
manufacturer. 

The 1080 material is placed on the outside layers of the subassembly. The 3313 
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material is rich in resin and freely gives up that resin to be pressed into etched copper areas. 
Unfortunately, this can leave areas on the subassembly surface without enough pressure 
during lamination to adhere the glass to the core. The 1080 material fills in, thus avoiding 
these areas of low pressure and producing a smooth, fully laminated sheet in preparation for 
5 the final lamination cycle. 

5.1.3 Providing for Alignment 

Panel masks conventionally contain ahgnment marks (see marks 202, 204 in Figures 
7 and 20). These marks are registered in each layer such that when the material stack is built 
up prior to booking, the layers can be co-aUgned by aligning the marks. 

IjO The dual lamination cycle presents a problem with respect to aligmnent. Once a 

conductive layer, e.g., LI 6, has been laminated to glass during the first lamination cycle, the 
aligmnent marks are obscured and cannot be used to align the layers in the second lamination 
cycle with the desired accuracy. 

In the preferred embodiments, notching the glass sheets prior to the first lamination 

15 cycle solves this problem. As illustrated in Figure 22a, a power core 210 has alignment 

marks 202 and 204. Six glass sheets 220, 221, 224, 225 (3313 material) and 222, 226 (1080 
material) are cut to size, and then notched at locations 206, 208 where the glass sheets will 
overlay the ahgnment marks. After the first lamination cycle, glass sheets 220, 222, 224 and 
226 are bonded to power core 210, but do not obscure alignment marks 202 and 204 (see 

20 Figure 22b) in the intermediate assembly 230. Consequently, the second lamination cycle 

can rely on marks 202, 204 to properly ahgn the intermediate assembUes with the other cores. 

It is acknowledged that in the final panel assembly, either very poor fill — or no fill — 
may be observed at the location of notches 206, 208. The ahgnment marks are placed in non- 
critical locations, far from the board itself or any coupons such that delamination near the 

25 aligmnent marks is of little concern. 
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5.1.4 Second Lamination Cycle 

The backplane panel is formed by stacking and aligning the copper-patterned cores 
from the different high-speed and low-speed layers with intermediate power core assemblies 
from the first lamination cycle, in the order depicted in Figure 9. As shown in Figure 9, 
where high-speed layers are adjacent, the ground plane of one high-speed layer faces the 
high-speed fraces of the adjacent high-speed layer, with two sheets of 50.6% 3313 N6000-21 
b-stage glass interposed. Adjacent low-speed layers are also stacked with two interposed b- 
stage sheets, but the material has 60.3% resin content. Between ground plane LI 5 and the 
intermediate glass layers laminated to power return L16, three sheets of 60.3% 1080 N6000- 
21 b-stage glass are interposed. The same arrangement is interposed between layers LI 9 and 
L20. Four such glass sheets are interposed between the two intermediate power core 
assemblies (between layers LI 7 and LI 8). 

Once the copper-patterned cores and the b-stage sheets are stacked and aligned, the 
material stack is placed in a booking press. The entire stack is booked under laminating 
conditions as recommended by the manufacturer. 

After the material stack is cooled, the thru-holes are drilled in the backplane, and the 
entire assembly is plated with one-ounce copper. The pads are then patterned, and a 
protective mask is added to complete the board. Connectors are then press-fit to the 
appropriate locations of the board to complete the backplane assembly. 

5.1.5 DriU Cycle 

Due to the thickness of the material stack and the multiple metal pads that are drilled 
through during via fabrication, the drill bit can become hot. This raises the probabiUty that 
the glass may become hot enough to allow the bit to "spin" a deadpad or a conductive pad. 
Spinning a pad refers to the pad delaminating or tearing loose from the glass under drilling 
pressure, thereby damaging the board and possibly mining it. 
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To avoid spun pads, the preferred drill cycle, and the board itself, have been designed 
to keep the drill bit cool. The drill is programmed to perform a "multi-peck" drill cycle for 
each critical via. A first peck of the drill bit penetrates the board to approximately halfway 
between layers L17 and L18, i.e., halfway through the board. As the nominal thickness of the 
dielectric between LI 7 and LI 8 is 24 mils, there is considerable margin for error in setting 
the depth of this peck. It is, however, believed to be important that the furst peck not end 
right at a conductive layer, as this may cause the drill bit to grab and tear the copper pad 
when inserted for the second peck. 

After the first peck, the drill bit is extracted from the partial via briefly, allowing heat 
to dissipate from the bit and the partial via. The drill bit then performs a second peck at the 
same location, this time penetrating through to the bottom of the board. 

If the board-thickness variance from board to board or lot to lot is significant, it may 
not be sufficient to program the drill with a preset depth for the first peck. In such case, an 
unneeded portion of the panel can be sectioned and measured in order to adjust the drill depth 
individually for each board or lot. 

5.1.6 Thieving 

Very little of the plated copper on each high-speed and low-speed layer is actually 
needed to form the signaUng traces (see, e.g.. Figure 20). On the other hand, each of these 
layers shares a core with a ground plane layer (see, e.g.. Figure 24) that uses a great deal of 
the copper originally plated on the core. Because of this disparity in copper coverage, it has 
been found that the patterned cores tend to curl, making them difficult to work with. Further, 
it has been fovmd that during the booking process, the high-speed and low-speed traces 
tended to migrate slightly towards the edges of the board, resxilting in misalignment in the 
final panel. Thieving also helps in maintainmg a consistent dielectric thickness across the 
board, which provides a benefit of better impedance uniformity. 
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To combat these problems, the preferred embodiments use "thieving" in the signaling 
layer masks. In the present disclosure, thieving consists of a pattern, such as pattern 240 in 
Figure 20, of unconnected copper mesas in areas of the board that are trace-free and via-free. 
Because the preferred embodiments avoid layer-swapping vias, the non-connector regions of 
5 the board are generally via-free and suitable for thieving. 

Figure 23 illustrates a magnified section of panel 200 from Figure 20 in order to better 
illustrate the use of thieving. The thieving pattern 240 on the high-speed layers is laid out in 
a grid pattern. Each "dot" is a 50-mil diameter copper mesa. The dots are spaced 75 mils 
center-to-center in a grid pattern. On the high-speed layers, a 1 50-mil spacing is maintained 
1 0 between the thieving pattern and the closest trace or via. On the low-speed layers, a 1 00-mil 
spacing is maintained between the thieving pattern and the closest trace or via, on either the 
same layer or the neighboring low-speed layer. Also, for neighboring low-speed layers (the 
£ L13/L14 pair, and the L21/22 pair), the thieving pattern is interlaced in a "star-dot" pattern as 
^ shown in Figure 25. 

15 5.1.7 Flow Dams 

On each layer, the panel outside of the board region is designed with flow dams 250 
(see Figure 20). The flow dams resist the flow of resin out the sides of the panel during 
booking, thereby forcing the resin to fill internal voids in the board pattern as much as 
possible. But the flow dams do not completely stop the flow of resin — a. confroUed flow 
20 keeps as much resin as possible without creating pressure at the position where the outer edge 
of the board will be routed from the panel. It is beheved that this step reduces the chance of 
delamination at the outer edge of the board during routing. 

5.2 Hybrid-Lamination Design 

The preferred core makeups for the high-speed layers in the hybrid lamination design 
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are identical to the core makeup described for the dual lamination cycle design. The low- 
speed cores and power cores are different, however. Each low-speed or power core is made 
of 1080 N4000-6, with a 57.5% (low-speed) or 63.5% (power) resin content. The power 
cores are made of two glass sheets, and the low-speed cores are made of two glass sheets. 

It has been found that dual lamination cycles can be avoided with N4000-6 as that 
material flows and reflows much easier than N6000-21 . Thus once the cores have been 
roughened as described for the dual lamination cycle design, all cores are stacked for 
booking. B-stage glass sheets for the high-speed cores are identical to the sheets described 
for the dual lamination cycle. Two glass sheets of 57.5% 1080 N4000-6 are placed between 
adjacent low-speed cores. Three glass sheets of 63.5% 1080 N4000-6 are placed between the 
adjacent low-speed and power cores. And four sheets of 63.5% 1080 N4000-6 are placed 
between the two power cores. 

5.2.1 Lamination Cycle 

A smgle lamination cycle is used to book the hybrid panel. Laminating conditions as 
recommended by the manufacturer are used. 

5.2.2 Teardrop Pad Construction 

Like with the dual lamination cycle design, precautions have been taken with the 
hybrid design to greatly reduce the possibility of spun pads. It is beheved that FR4 reflows 
much easier than N6000 due to the heat of drilluig and this increases the propensity for spun 
pads in the FR4 portion of the material stack. Like with the dual lamination cycle design, a 
multi-peck drill cycle is used. But in addition, signal pads in the low-speed layers are formed 
as teardrop pads, i.e., each low-speed pad is augmented with a "half pad" displaced from the 
first pad to form a teardrop pad. The teardrop is directed towards the trace connected to the 
pad. Figure 24 illustrates the construction of one teardrop pad 260. 

Teardrop or oversize pads are sometimes used with lower-cost boards to compensate 
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for poor drill tolerances. But the inventors believe this to be the first use of such pads in a 

design that does not need teardrop pads to compensate for a poor drill process, where during 
drilling the tolerance allows the via to be offset towards the end of the teardrop. This sturdier 
pad is simply much better at resisting spinning during drilling. 

5 5.2.3 DrUl Cycle 

A multi-peck drill cycle using three separate pecks is preferred for the hybrid design. 
Three pecks allows the drill to cool once before entering the FR4 portion of the board, and 
f: once just after leaving the FR4 portion of the board. 

m 

Ul The preferred endpoint for the first peck is in the dielectric layer between HS4 (layer 

m 

^VO L09) and the underlying digital ground plane at layer LI 0 (see Figure 8). This endpoint is 

Ui 

I,, selected to ensure that any pad at layer L09 will have already been drilled through, and thus 
will not be spun on the second peck. Also, when the drill is inserted for the second peck, at 

m 

r\ LIO it will encounter either solid copper or an empty via space, but not a pad. 

ru 

Similar considerations lead to a preferred endpoint for the second peck in the 
15 dielectric layer between Signal x2 (layer L22) and the underlying digital ground plane at 

layer L23. 

One of ordinary skill in the art will recognize that the concepts taught herein can be 
tailored to a particular application in many other advantageous ways. Although specific high- 
speed and low-speed dielectric materials are used in the preferred embodiments, the principle 

20 of using a different dielectric material or different resin content for thicker, embedded power 
distribution planes can be adapted to other materials and material stacks. The material stack 
need not be symmetric about its center as shown in the preferred embodiments. As another 
example, the principle of routing differential pairs past ground thru-holes by splitting them 
around those holes can be adapted to connector patterns other than those used by the AMP 

25 HS3 connector geometry. Although a backplane embodiment has been disclosed, the 
Docket #3981-8 40 



concepts taught herein apply equally to other interconnection arrangements such as 
midplanes. And in other designs, the concept of allocating signal planes to individual switch 
fabric cards could be reversed, allocating signal planes to individual line cards. 

Although the specification may refer to "an", "one", "another^', or "some" 
embodiment(s) in several locations, this does not necessarily mean that each such reference is 
to the same embodiment(s), or that the feature only applies to a single embodiment. 
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